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(54) Method of creating image frames, storage medium and program executing apparatus 



(57) A dynamic image is decorated effectively with 
a small of processing volume. As shown in Figs. 6A and 
6B, images A that form a dynamic image representing 
a spreading firework are sequentially created in order in 
time in which the images appear in the dynamic image. 
On the currently created image shown in Fig. 6A, an im- 
age obtained by enlarging a spark portion of the image 
preceding the current image by a predetermined 
number is drawn in such a manner that it looks semi- 
transparent to obtain the image as shown in Fig. 6B. 
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Description 

[0001] This application claims a priority based on Jap- 
anese Patent Application 1 1 -261 1 36 filed on September 
1 4, 1 999, and 2000-233092 filed on August 1 , 2000. the 
entire contents of which are incorporated herein by ref- 
erence for all purposes. 

BACKGROUND OF THE INVENTION 

[0002] The present invention relates to a technique for 
decorating a dynamic image. 

[0003] A dynamic image created utilizing computer 
graphics is widely used in the field of entertainment such 
as games and animation. In the field of such an enter- 
tainment, fineness and force of a dynamic image con- 
stitute important factors for entertaining users. 
[0004] One known technique to improve fineness and 
force of an objective dynamic image is to draw an image 
for decoration or each image forming a dynamic image 
for decoration, which is created separately from the ob- 
jective dynamic image, on each image frame forming 
the objective dynamic image having already been cre- 
ated. 

SUMMARY OF THE INVENTION 

[0005] However, creating an image or a dynamic im- 
age separately from an objective dynamic image only 
for a purpose of such decoration may cause an in- 
creased processing load. Therefore, there is a certain 
limit on to decorate the objective dynamic image using 
such a technique. 

[0006] Further, in order to achieve a high decorative 
effect, it is preferable to use a dynamic image or an im- 
age having high correlation with the objective dynamic 
image. However, it is not sufficiently considered in con- 
ventional techniques for decorating an objective dynam- 
ic image using an image or a dynamic image which is 
created separately from the objective dynamic image. 
[0007] The present invention has been made taking 
the above-described situation into consideration, and it 
is an object of the invention to achieve a high decorative 
effect in decorating an objective dynamic image with a 
smaller processing volume. 

[0008] In order to achieve the above-described ob- 
ject, according to the present invention, there is provid- 
ed a method of creating image frames forming a dynam- 
ic image, the method having: 

a drawing step which sequentially draws the image 
frames forming the dynamic image according to or- 
der in time in which the image frames appear in the 
dynamic image; 

an accumulation step which accumulates a part of 
at least one of the image frames drawn at the draw- 
ing step; and 

a decorating step for decorating each of the image 



frames forming the dynamic image by synthesizing 
each of the image frames drawn at the drawing step 
with an image obtained by enlarging the part of at 
least one of the image frames which has been 
s drawn earlier than the image frames to be decorat- 
ed. 

[0009] According to the present invention, since an 
image obtained by enlarging a part of at least one of 
10 image frames forming a dynamic image is used for dec- 
orating, there is no need for creating an image for dec- 
orating separately, resulting in a reduction of processing 
volume. 

[0010] Further, since this image for decoration is a 
is part of a dynamic image to be decorated, it has high cor- 
relation with the dynamic image to be decorated, and a 
high decorative effect is expected. 
[0011] When each image used for decorating each 
image frame forming a dynamic image is always created 
zo as predetermined number of images preceding the im- 
age frame concerned, the images used for decorating 
also form a dynamic image. It is therefore a higher dec- 
orative effect is expected. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

[0012] Fig. 1 illustrates an appearance of an enter- 
tainment apparatus and a controller therefor according 
to an embodiment of the invention. 
30 [001 3] Fig. 2 is a block diagram showing a configura- 
tion of the entertainment apparatus according to the em- 
bodiment. 

[0014] Fig. 3 is an illustration for explaining contents 
of a video game according to the embodiment. 
35 [0015] Fig. 4 is a flow chart for explaining a process 
of creating a CG animation for the entertainment appa- 
ratus according to the embodiment. 
[0016] Figs. 5A through 5G are illustrations for ex- 
plaining a process of drawing sparks of fire performed 
to by the entertainment apparatus when the video game 
according to the embodiment is provided. 
[0017] Figs. 6A and 6B are illustrations for explaining 
a process of decorating a displayed image performed 
by the entertainment apparatus when the video game 
4 5 according to the embodiment is provided. 

[0018] Fig 7 is a flow chart for explaining a process of 
accepting operations of a player in the entertainment ap- 
paratus according to the embodiment. 
[0019] Figs. 8A through 8F are illustrations for ex- 
50 plaining a user interface provided by the entertainment 
apparatus when the video game according to the em- 
bodiment is provided. 

[0020] Figs. 9A through 9F are illustrations for ex- 
plaining a user interface provided by the entertainment 
55 apparatus when the video game according to the em- 
bodiment is provided. 

[0021] Figs. 10A and 10B are illustrations for explain- 
ing a range of an induced explosion which is controlled 
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by the entertainment apparatus when the video game 
according to the embodiment is provided. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 5 

[0022] A preferred embodiment of the invention will 
now be described with reference to an example of the 
application of the invention to an entertainment appara- 
tus. 10 
[0023] Fig. 1 shows an appearance of the entertain- 
ment apparatus according to the present embodiment. 
[0024] The entertainment apparatus reads a game 
program stored in, for example, an optical disk or the 
like and executes the game program in accordance with 15 
instructions from a user (a game player). The term "ex- 
ecution of a game" primarily means an operation of con- 
trolling progress, display and sounds of a game. 
[0025] As illustrated, a main body 2 of the entertain- 
ment apparatus 1 has a disk mounting portion 3 located 20 
in the middle thereof for mounting an optical disk such 
as a CD-ROM which is a recording medium for supply- 
ing an application program such as a video game, a re- 
set switch 4 for resetting a game, a power supply switch 
5, a disk operating switch 6 for operating the mounting 25 
of the optical disk and, slot portions, for example, two of 
them, 7A and 7B. 

[0026] Two controllers 20 can be connected to the slot 
portions 7A and 7B to allow two users to play a fighdng 
game or the like. The slot portions 7A and 7B accept a 30 
memory card device 26 in and from which game data 
can be saved (stored) and read or portable digital appa- 
ratus 100 which allows a game to be executed sepa- 
rately from the main body. 

[0027] The controller 20 has first and second operat- 35 
ing portions 21 and 22, an L-button 23L, an R-button 
23R, a start button 24 and a selection button 25. It further 
has operating portions 31 and 32 which enable analog 
operations, a mode selection switch 33 for selecting a 
mode of operation of the operating portions 31 and 32 40 
and a display portion 34 for displaying a selected mode 
of operation. 

[0028] A configuration of the entertainment apparatus 
1 is shown in Fig. 2. 

[0029] As illustrated, the entertainment apparatus 1 45 
has a control system 50 constituted by a central 
processing unit (CPU) 51, peripheral devices therefor, 
etc. , a graphic system 60 including a graphic processing 
unit (GPU) 62 for performing drawing in a frame buffer 
63, etc., a sound system 70 including a sound process- so 
ing unit (SPU) 71 for generating sounds of music, sound 
effects, etc., an optical disk control unit 80 for controlling 
an optical disk 81 on which an application program is 
recorded, a communication control unit 90 for controlling 
signals from the controller 20 through which instructions ss 
from a user are inputted, and input and output of data 
from and to the memory card 26 and portable digital ap- 
paratus 1 00 which store a setting of a game and the like, 



and a bus BUS or the like for connecting the above-de- 
scribed parts. 

[0030] The control system 50 has the CPU 51 , a pe- 
ripheral device control unit 52 for controlling operations 
such as interrupts and direct memory access (DMA) 
transfers, a main memory 53 constituted by a RAM (ran- 
dom access memory) and a ROM (read only memory) 
54 in which programs such as a so-called operating sys- 
tem (OS) for managing the main memory 53, graphic 
system 60, sound system 70, etc. are stored. 
[0031] The CPU 51 executes the operating system 
stored in the ROM 54 to control the entertainment ap- 
paratus 1 as a whole and is constituted, for example, by 
a RISC-CPU. 

[0032] In this entertainment apparatus 1 , when the 
power is turned on, the CPU 51 of the control system 
50 executes the operating system stored in the ROM 54 
to control the graphic system 60, sound system 70, etc. 
[0033] When the operating system is executed, the 
CPU 51 also performs initialization of the entertainment 
apparatus 1 as a whole including operation check and 
thereafter controls the optical disk control unit 80 to ex- 
ecute an application program such as a game recorded 
on the optical disk. When the program such as a game 
is executed, in accordance with instructions from the us- 
er, the CPU 51 controls the graphic system 60, sound 
system 70, etc. to control display of images and gener- 
ation of music sound and sound effects. 
[0034] The graphic system 60 has a GTE (geometry 
transfer engine) 61 for processing such as coordinate 
transformation, a GPU 62 for performing a drawing proc- 
ess according to drawing instructions from the CPU 51 , 
a frame buffer 63 for storing images drawn by the GPU 
62, and an image decoder 64 for decoding image data 
which have been compressed and encoded through or- 
thogonal transformation such as discrete cosine trans- 
formation. 

[0035] For example, the GTE 61 has a parallel calcu- 
lation function for performing a plurality of calculations 
in parallel, and it performs calculations of matrices, vec- 
tors and the like, such as coordinate transformation cal- 
culations at a high speed. Specifically, the GTE 61 per- 
forms calculations such as perspective transformation 
for rendering in a case wherein a virtual three-dimen- 
sional object is formed using a set of, for example, tri- 
angular polygons and a projected image of a three-di- 
mensional model is obtained by projecting the three-di- 
mensional object upon a virtual camera screen, i.e., cal- 
culations of coordinate values of the vertexes of each 
polygon as projected upon the camera screen. 
[0036] Next, the GPU 62 performs rendering of the 
three-dimensional object to create an image in the frame 
buffer 63 utilizing the GTE 61 in accordance with a com- 
mand from the CPU 51 . As a technique for erasing hid- 
den lines and hidden surfaces used for rendering, the 
Z-buffer method, scan line method, ray tracing method 
or the like may be used. As a technique for shading, the 
flat shading method, glow shading method, ray tracing 
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method or the like may be used. As a technique for ren- 
dering surface textures and patterns on a surface of the 
tree-dimensional object, texture mapping or the like may 
be used. 

[0037] Next, the frame buffer 63 is constituted by a 5 
so-called dual port RAM and is capable of allowing the 
rendering by the GPU 62 or transferring from the main 
memory 53 and readout for display simultaneously. A 
texture region for storing textures used for the above- 
described texture mapping or the like is provided in the io 
frame buffer 63 in addition to an image region in which 
readout for rendering and display is carried out. 
[0038] The image decoder 64 decodes image data of 
still images and dynamic images stored in the main 
memory 53 under control of the CPU 51 and stores it in is 
the main memory 53 again. The decoded image data 
can be used as a. background of an image to be ren- 
dered by the above-described GPU 62 by storing the 
decoded image data in the frame buffer 63 via the GPU 
62. 20 
[0039] The sound system 70 has an SPU 71 for gen- 
erating sounds of music, sound effects etc. in accord- 
ance with instructions from the CPU 51 , a sound buffer 
72 in which waveform data and etc. are stored by the 
SPU 71 , and. a speaker 73 for outputting the sounds of 25 
music, sound effects, etc. generated by the SPU 71. 
[0040] The SPU 71 has functions such as an ADPCM 
(adaptive differential PCM) decoding function for repro- 
ducing audio data which have been subjected to AD- 
PCM, and a reproducing function for reproducing the 30 
waveform data stored in the sound buffer 72 to generate 
sound effects and etc, and a modulating function for 
modulating and reproducing the waveform data stored 
in the sound buffer 72. Such functions allow the sound 
system 70 to be used as a so-called sampling sound 35 
source which generates sounds of music, sound effects, 
etc. based on the waveform data stored in the sound 
buffer 72 according to instructions from the CPU 51 . 
[0041] The optical disk control unit 80 has an optical 
disk device 81 for reproducing a program, data or the *o 
like recorded on an optical disk, a decoder 82 for decod- 
ing a program, data or the like which is recorded with, 
for example error correction codes (ECCs) added ther- 
eon, and a buffer 83 for temporarily storing data from 
the optical disk device 81 to increase the speed of read- 45 
ing from the optical disk. A sub CPU 84 is connected to 
the decoder 82. 

[0042] Audio data recorded in an optical disk read by 
the optical disk device 81 includes so-called PCM data 
which is obtained by performing analog-to-digital con- so 
version on an audio signal in addition to the above-de- 
scribed ADPCM data. The ADPCM data is supplied to 
the above-described SPU 71 after being decoded by the 
decoder 82, is subjected to processes such as digital- 
to-analog conversion at the SPU 71 and is used for driv- 55 
ing the speaker 73. The PCM data is subjected to proc- 
esses such as a digital-to-analog conversion at the SPU 
71 and is thereafter used for driving the speaker 73. 



[0043] The communication control unit 90 has a com- 
munication controller 91 for controlling communication 
with the CPU 51 through the bus BUS. Provided at the 
communication controller 91 are a controller connecting 
unit 12 to which the controller 20 for inputting instruc- 
tions from a user is connected and memory card insert- 
ing units 8A and 8B to which the memory card 26 and 
portable digital apparatus 100 as auxiliary storages for 
storing game setting data and the like. 
[0044] The controller 20 connected to the controller 
connecting unit 12 transmits states of the above-de- 
scribed buttons and operating portions to the communi- 
cation controller 91 with synchronous communication in 
accordance with instructions from the communication 
controller 91 in order to allow instructions from the user 
to be accepted. The communication controller 91 trans- 
mits the state of the buttons and operating portions of 
the controller 20 to the CPU 51 . 
[0045] Thus, instructions from the user are inputted to 
the CPU 51 , and the CPU 51 performs processes in ac- 
cordance with the instructions from the user, based on 
the game program, etc., which is being executed. 
[0046] When a program is read or an image is dis- 
played or drawn, image data must be transferred at a 
high speed between the main memory 53, CPU 62, im- 
age decoder 64, decoder 82, etc. For this reason, as 
described above, the entertainment apparatus 1 is 
adapted to allow so-called DMA transfer in which data 
is directly transferred between the main memory 53, 
CPU 62, image decoder 64, decoder 82, etc., under the 
control of the peripheral device control unit 52 without 
intervention of the CPU 51. This makes it possible to 
reduce loads to the CPU 51 associated with data trans- 
fers, thereby allowing data transfers at a high speed. 
[0047] Further, when it is necessary to store setting 
data or the like of a game being played, the CPU 51 
transmits the data to be stored to the communication 
controller 91, and the communication controller 91 
writes the data from the CPU 51 in the memory card 26 
or the portable digital apparatus 100 inserted in the slot 
of the memory card inserting unit 8A or 8B. 
[0048] The communication controller 91 has a protec- 
tion circuit for preventing electrical breakdown. The 
memory card 26 and portable digital apparatus 1 00 are 
separated from the bus BUS and can be inserted and 
removed while the power supply of the apparatus main 
body 2 is on. Therefore, in the case of a shortage of the 
memory capacity of the memory card 26, or the portable 
digital apparatus 100, a new memory card or the like 
can be inserted without turning the power supply of the 
apparatus main body 2 off. This prevents loss of game 
data which is to be backed up and makes it possible to 
write the necessary data in a new memory card by in- 
serting the new memory card. 

[0049] A parallel I/O interface (PIO) 96 and a serial I/ 
O interface (SIO) 97 are interfaces for connecting the 
memory card 26 and portable digital apparatus 100 to 
the entertainment apparatus 1 . 
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[0050] A configuration of the entertainment apparatus 
1 has been described above. 

[0051 ] A description will now be made on an operation 
or the entertainment apparatus 1 of the present embod- 
iment, when a video game is played in accordance with 
an application program stored in an optical disk inserted 
in the disk inserting portion 3. 

[0052] The video game will be first described briefly. 
[0053] As shown in Fig. 3, the video game executed 
by the entertainment apparatus 1 of the present embod- 
iment is a game in which a player captures and explodes 
firework balls 602 which are set off one after another in 
the air in the urban scenery on the background so as to 
display fireworks explosion of the firework balls 602, 
while monitoring their images shot by a camera 601 . 
[0054] In order to establish such a game, the enter- 
tainment apparatus 1 of the present embodiment ac- 
cepts operations of a player and creates a CG animation 
which proceeds in accordance with the operations of the 
player. 

[0055] First, a description will be made on the opera- 
tion of creating a CG animation. 

[0056] Fig. 4 is a flow chart for explaining a process 
of creating a CG animation in the entertainment appa- 
ratus 1 of the present embodiment. 
[0057] The CPU 51 operates following the flow shown 
in Fig. 4 to create a CG animation in accordance with 
an application program . and various data stored in an 
optical disk mounted in the disk mounting portion 3. 
[0058] Specifically, the CPU 51 moves the camera 
601 in accordance with a predetermined path or opera- 
tions of the player on the controller 20 in a world coor- 
dinate space in which a three-dimensional model of a 
grand and a city on the grand are disposed, and dispos- 
es the firework balls 602, being three-dimensional ob- 
jects, one after another, from a position fixed with re- 
spect to the camera 601 . This position may be fixed, for 
example, at a lower position with respect to the camera 

601 by a predetermined distance in a height direction of 
the world coordinate space. The CPU 51 simulates a 
change in the position (movement) of each firework ball 

602 that occurs when it is set off forward the upper di- 
rection at a predetermined initial velocity, and makes the 
exploded firework balls 602 disappear from the world 
coordinate space. Alternatively, the exploded firework 
balls 602 are made disappear from the world coordinate 
space and provides new firework balls in positions in the 
world coordinate space corresponding to the positions 
of the exploded firework balls (step S1001). As will be 
described later, which firework ball 602 is to be exploded 
is determined by an operation accepted from the user. 
[0059] The CPU 51 sets a plurality of spark center 
points in the world coordinate space for the firework ball 
602 to be exploded, according to preset attributes of the 
firework ball 602, and simulates a change in the position 
(movement) of each spark center point that occurs when 
each spark center point is emitted at a predetermined 
initial velocity in a direction determined by the attributes, 
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e.g., in the radial direction from the center point of the 
firework ball 602 to be exploded (step S1002). 
[0060] The CPU 51 periodically performs first coordi- 
nate transformation using the GTE 61 to transform the 
s coordinates of the three-dimensional models such as 
the city and the firework balls 602 represented by a 
number of polygons provided in the world coordinate 
space, and the center point of each spark represented 
by a dot into coordinates on an XYZ coordinate system 
10 (screen coordinate system) in which the camera posi- 
tion is the origin and the line of sight of the camera is 
the direction of the Z-axis. The CPU 51 also performs 
second coordinate transformation on the coordinates X 
and Y of each coordinate value obtained by the first co- 

*5 ordinate transformation to provide a two-dimensional 
coordinate which is obtained by multiplying the coordi- 
nates X and Y by a value Q which becomes smaller ac- 
cording to a predetermined function, the greater the Z- 
value is (arithmetic matrix). The CPU 51 extracts points 

20 at which the X and Y of the coordinate after the calcu- 
lation are included in the ranges from -W/2 to W/2 and 
from -H/2 to H/2, respectively, where W and H represent 
the size of the camera screen which is the projecting 
surface. The coordinates of each of the extracted points 

25 are shifted in the X-and Y-directions by W/2 and -H/2 
respectively, and the resultant X and Y coordinates are 
defined as coordinates on the camera screen (two-di- 
mensional coordinate) associated with the extracted 
points (step S1004). The above-described Q-value is 

30 used to represent perspective and basically causes co- 
ordinate transformation such that an object located fur- 
ther way from the camera than another object is dis- 
played closer to the line of sight (i.e., in a position closer 
to the center of the camera screen), even if those objects 

35 are located at a same distance from the line of sight in 
a perpendicular direction. 

[0061] When the CPU 51 calculates on the camera 
screen as described above, the coordinates of the three- 
dimensional models provided in the world coordinate 

*o space, such as the city and the firework ball 602 and the 
center points of sparks, the CPU 51 allows the GPU 62 
to draw them on the camera screen in the order of their 
decreasing distances in the direction of the depth of the 
screen coordinate system. A first rendering image is 

4 $ thus generated (step 51 005). 

[0062] Referring to the drawing of the firework balls 
602 at this time, after-images of the firework balls are 
also drawn using a motion blurring technique to repre- 
sent the tail of the firework balls 602. The CPU 51 man- 

50 ages the attributes of individual firework balls 602 which 
exist in the world coordinate space and also manages 
the drawing range of each firework ball 602 drawn in the 
first rendering image as one of those attributes. As de- 
scribed above, whether to provide a new firework ball in 

55 a position associated with the exploded firework 602 is 
determined by its attributes. That is, the firework balls 
602 sequentially disposed in the world coordinate space 
by the CPU 51 include firework balls having different at- 
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tributes, i.e., different kinds of firework balls. 
[0063] Each spark is drawn by pasting a texture rep- 
resenting the spark in a position of the camera screen 
corresponding to the center point of the spark, the tex- 
ture having a size in accordance with the distance or the 
like of the center point of the spark from the camera. 
Specifically, the texture of the spark is drawn on the first 
rendering image with a size which is obtained by multi- 
plying the original size of the texture of the spark by a 
Q-value obtained by the above-described calculation. A 
texture of a spark is a two-dimensional image which is 
stored by the CPU 51 in the texture region of the frame 
buffer 63 in advance and which has a predetermined 
shape, colors and patterns representing the spark that 
appears when an actual firework is exploded. Such a 
texture is drawn in the position of the center point of a 
spark with a size in accordance with a Q-value obtained 
by the above calculation such that it always face forward 
(i.e., such that the texture always faces in the direction 
of the Z-axis in the XYZ coordinate system whose origin 
is the camera and whose Z-axis is the line of sight (the 
screen coordinate system)). The above-described coor- 
dinate transformation (arithmetic matrix) transforms the 
coordinate of the center point of the spark, instead of 
transforming the coordinate of each vertex of the poly- 
gon a plurality of which represent a three-dimensional 
shape. Pasting a polygon that faces forward at the cent- 
er point thereof always represents each spark. This 
means that a same matrix can be used to perform co- 
ordinate, transformation on the coordinates of each of 
the center points of sparks. This also means that there 
is no need for considering changes in the direction of 
the polygons representing the sparks attributable to the 
turning of the camera unlike three-dimensional models 
which represent the city and the firework balls 602 pro- 
vided in the world coordinate space. 
[0064] A specific example of this process will now be 
described with reference to Figs. 5A through 5G. Let us 
assume that the center 70 1 represents a center of ex- 
plosion of a certain firework ball 602 and that centers 
702 of 24 sparks in total are released from the center 
701. Then, the position of center 702 of each of the 
sparks sequentially changes as shown in Figs. 5A, 5B 
and 5C. Let us assume that the state at the current point 
in time is shown in Fig. 5C. Then, a spark texture shown 
in Fig. 5D is pasted in a position on the camera screen 
corresponding to the center 702 of each of the sparks 
shown in Fig. 5C to obtain an image of sparks which are 
arranged like a circle as shown in Fig. 5E, i.e., an image 
of an exploded firework. 

[0065] Such a technique in which changes only in the 
central position of an object to be drawn are regularly 
simulated and an image of the object is drawn by pasting 
a texture image at the central position makes it possible 
to draw an object with a quite small processing load in 
a quit short processing time compared to conventional 
techniques in which an object is represented as a three- 
dimensional image whose three-dimensional shape is 



represented by a plurality of polygons and in which var- 
ious processes required for rendering a 3D model are 
carried out, the processes including simulation of 
changes in the position of each of the vertexes of each 

5 polygon forming a part of the three-dimensional model 
and perspective transformation thereof. 
[0066] Next, the CPU 51 stores, as to each spark on 
a predetermined number of first rendering images that 
trace back to the past starting with the current point in 

io time, the history of the coordinates of the center points 
of the spark concerned. The CPU 51 allows the CPU 62 
to draw, as to each spark, line segments connecting the 
center points in the history on the current first rendering 
image such that the center point of a spark becomes 

15 more transparent, namely, blending ratio of the line seg- 
ments with the first rendering image becomes smaller, 
the older it is in the history (step S 1006). Here, points in 
the history in the first rendering images in the past at 
predetermined time intervals may be used, and line seg- 

20 ments connecting those center points of each spark may 
be drawn. 

[0067] Referring to Figs. 5A through 5G, let us as- 
sume that the history of points shown in Fig. 5F associ- 
ated with the history of each spark center point 702 

25 shown in Figs. 5A, 5B and 5C in which Fig. 5C repre- 
sents the current point in time and Figs. 5A and 5B rep- 
resent earlier points in time are used. Then, since three 
points on the same radial line are associated with the 
same spark center point 702, line segments connecting 

30 those lines associated with each other are drawn. As a 
result, an image is obtained in which a locus of each 
spark is represented, as shown in Fig. 5G. 
[0068] With such a technique in which a locus of a dis- 
played matter is represented by drawing line segments 

35 connecting a plurality of positions that form a history of 
the position of the displayed matter, the locus of the dis- 
played matter can be represented with a quit small 
processing load in a quite short processing time com- 
pared to those of conventional techniques such as mo- 

40 tion blurring. 

[0069] While only the sparks and their loci are drawn 
by pasting textures and drawing line segments in the 
above-described manner in the present embodiment, 
the firework balls and their loci may also be similarly 

45 drawn by pasting textures and drawing line segments. 
[0070] Next, a first rendering image with line seg- 
ments drawn thereon is now referred to as "a second 
rendering image n , and the CPU 51 allows the GPU 62 
to enlarge, using interpolation based on the bilinear or 

50 trilinear filtering technique, a part of an image of sparks 
drawn on a second rendering image which was created 
at a past point in time preceding the current point in time 
by a quantity corresponding to a predetermined number 
of second rendering images. The enlarged image is 

55 drawn on the second rendering image at the current 
point in time as a semi-transparent image (by blending 
the enlarged image with the second rendering image) 
to obtain, finally, a rendering image which is displayed 
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as a display image (step S1007). 
[0071] In order to obtain such a display image, the 
CPU 51 stores parts of images of sparks drawn on a 
predetermined number of second rendering images in 
the past. " 5 

[0072] Such a process provides a brilliant display im- 
age as shown in Fig. 6B decorated with enlarged sparks, 
which is a version of a second rendering image shown 
in Fig.6A. 

[0073] With such a technique for decorating the cur- w 
rent image with an image obtained by enlarging a part 
of an image created in the past, decoration can be pro- 
vided with a reduced number of processing steps be- 
cause there is no need for creating any separate image 
for decoration. Further, since a predetermined number is 
of past images are used as images for decoration, the 
images to be used for decoration change as time pass- 
es. As a result, such decorations can also be dynamic 
images, which make it possible to provide a quite sig- 
nificant decorative effects. 20 
[0074] Next, acceptance of operations of a player will 
be described. 

[0075] Fig 7 is a flow chart for explaining a process of 
accepting operations of a player in the entertainment ap- 
paratus 1 of the present embodiment. 25 
[0076] The CPU 51 operates according to the flow 
shown in Fig. 7 to accept operations of the player in ac- 
cordance with the application program recorded on the 
optical disk mounted in the disk mounting portion 3. 
[0077] Specifically, the CPU 51 displays a cursor 801 30 
on a display image as shown in Fig. 8A through the op- 
erating system (OS). The display portion of the cursor 
is moved in accordance with the operation of the player 
on the controller 20 (step S2001). 

[0078] As shown in Fig. 8B, the CPU 51 display a di- 35 
rectional line 802 which extends from the cursor in a di- 
rection specified by the player through a direction spec- 
ifying operation on the controller 20 through the OS 
(step S2002). 

[0079] The CPU 51 refers to drawing ranges of the 40 
firework balls 602 under its management indicated by 
the attributes thereof to detect a firework ball drawn in 
the vicinity of the directional line 802 drawn on the dis- 
play image and draws a mark 803 in the position of the 
detected firework ball as shown in Fig. 8C. Thereafter, 45 
the display position of the mark 803 is operated to follow 
up the movement of the detected firework ball (step 
S2003). When the player instructs lock-on by operating 
the controller 20 in this state (step 52004), lock-on is set 
as an attribute of the detected firework ball (step S2005). so 
Then, the mark 803 displayed in the position where the 
detected firework ball is drawn is erased and, as shown 
in Fig. 8D, color attributes of the detected firework ball 
are changed to change the display color, and the display 
position of the cursor 80 1 is moved to the position where 55 
the detected firework ball is displayed (step S2006). The 
display position of the cursor 801 may also be operated 
such that it thereafter follows up the movement of the 



detected firework ball. 

[0080] The detection of the firework ball 602 drawn in 
the vicinity of the directional line 802 is carried out by 
detecting any firework ball for which a line drawn from 
the position of the same perpendicularly to the direction- 
al line 802 is equal to or smaller than a predetermined 
length. When a plurality of firework balls 602 are detect- 
ed, a firework ball closest to the directional line 802 or 
the display position of the cursor 801 is detected as a 
firework ball drawn in the vicinity of the directional line 
802. It is not essential to draw the directional line 802 
actually, and the directional line 802 may only virtually 
set on the display image. 

[0081 ] With such a technique in which an object is se- 
lected and the cursor is moved using a directional line, 
the player can move the cursor and select the object 
promptly, in a shorter time compared to techniques in 
which an object is selected by moving the cursor to the 
object. 

[0082] When the player instructs explosion by oper- 
ating the controller 20, the CPU 51 chooses the firework 
ball for which a lock-on attribute is set as the firework 
ball to be exploded (step S2007). As a result, the above- 
described process allows the chosen firework ball to 
spread as shown in Figs. 8E and 8F As shown in Figs. 
9A through 9D, when lock-on is set in a plurality of fire- 
work balls through operations of the directional line and 
lock-on instructions made by the player consecutively, 
and then, the player instructs explosion of them, all of 
the firework balls for which lock-on is set are chosen as 
firework balls to be exploded. As a result, the above- 
described process allows those firework balls to spread 
as shown in Figs. 9E and 9F. 

[0083] The CPU 51 sets a range for an induced ex- 
plosion around an exploding firework balls drawn on the 
display image according to the attributes of the firework 
balls, for example, as indicated by the broken line in Fig. 
10A (step S2008). The CPU 51 refers to the drawing 
ranges of the firework balls under its management and 
chooses other firework balls drawn within the range for 
the induced explosion as firework balls to be exploded 
(step S2009). As a result, the above-described process 
allows the firework balls located around the exploded 
firework ball to be also exploded as shown in Fig.iOB. 
[0084] It is possible to also explode a new firework 
ball provided in a position associated with the position 
of the exploded firework ball using the range for the in- 
duced explosion set for the exploded firework ball. 
[0085] With such a technique in which a range for an 
induced explosion is set around an exploded object and 
in which other objects within the range for an induced 
explosion are exploded, such an induced explosion can 
be represented with a smaller processing load in a short- 
er processing time than those, for example, in a tech- 
nique in which collisions of sparks against a firework ball 
are calculated to simulate an actual induced explosion 
caused by such collisions against the firework. 
[0086] Referring to the new firework ball provided in 
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the position associated with the position of the exploded 
firework ball as described above, lock-on may be set in 
advance as the attribute of the new firework ball. The 
positions where ranges for an induced explosion are set, 
the time zone in which they are set, the number of them 
and whether they are moved or not may be determined 
by preset attributes of a firework ball which is exploded. 
A range for an induced explosion may be set around an 
exploded firework ball in the world coordinate space ac- 
cording to the attributes thereof, and another firework 
ball located within the range for the induced explosion 
in the word coordinate space may be chosen as a fire- 
work ball to be exploded. A range for an induced explo- 
sion may be set for each spark. 

[0087] The movement of the cursor, the specification 
of the direction of the directional line, the instruction for 
lock-on and the instruction for an explosion in each of 
the above processes may be accepted at any button or 
any operating portions on the controller 20. However, it 
is preferable at least to allow eight directions at angular 
intervals of 45 degrees to be accepted as moving direc- 
tions of the cursor and directions of a directional line. 
[0088] A preferred embodiment of the invention has 
been described above with reference to an application 
of the invention to a video game utilizing an entertain- 
ment apparatus. Any applications other than games are 
possible for the technique described with reference to 
an example of drawing of sparks (the technique to rep- 
resent an object to be displayed by calculating one point 
on the object to be displayed and pasting a texture at 
the calculated position), the technique described above 
with reference to an example of drawing of loci of sparks 
(the technique to draw a locus of a moving object by 
drawing line segments connecting positions that form a 
history of movement), the technique described above 
with reference to an example of drawing of an image of 
past sparks in an enlarged form (the technique to dec- 
orate a display image by drawing a past image thereon), 
the technique described above with reference to an ex- 
ample of selection of a firework ball by a player (the tech- 
nique to accept selection of an object based on a direc- 
tion and movement of a cursor) and the technique de- 
scribed above with reference to an example of a range 
for an induced explosion (the technique to find an object 
influenced by an object of interest based on a range set 
for the object of interest). 

[0089] Entertainment apparatuses according to the 
invention are not limited to video game machines and 
various apparatus for executing programs (electronic 
computers) such as personal computers, PDAs and 
portable telephones are included. 
[0090] As described above, the present invention 
makes it possible to decorate a dynamic image effec- 
tively with a small processing volume. 
[0091] In so far as the embodiments of the invention 
described above are implemented, at least in part, using 
software-controlled data processing apparatus, it will be 
appreciated that a computer program providing such 
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software control and a storage medium by which such 
a computer program is stored are envisaged as aspects 
of the present invention. 



Claims 

1 . A method of creating image frames forming a dy- 
namic image, said method comprising: 

a drawing step which sequentially draws said 
image frames forming said dynamic image ac- 
cording to order in time in which said image 
frames appear in said dynamic image; 
an accumulation step which accumulates a part 
of at least one of said image frames drawn at 
the drawing step; and 

a decorating step which decorates each of the 
image frames forming said dynamic image by 
synthesizing each of the image frames drawn 
at the drawing step with an image obtained by 
enlarging the part of at least one of the image 
frames which has been drawn earlier than the 
image frames to be decorated. 

2. A method of creating image frames according to 
Claim 1 , wherein at said decorating step, said im- 
age obtained by enlarging the part of at least one 
of said image frames which has been drawn earlier 
is synthesized with the image frames drawn at said 
drawing step in such a manner that said image is 
visually recognized as being semi-transparent. 

3. A method of forming image frames according to 
Claim 1 , wherein, the part of at least one of said 
image frames to be synthesized with one of said im- 
age frames to be decorated, is always a part of an 
image frame preceding one of said image frames 
to be decorated, by a predetermined number. 

4. A storage medium for storing a program read and 
executed by a program executing apparatus, said 
program allowing said program executing appara- 
tus to create image frames forming a dynamic im- 
age and allowing the program executing apparatus 
to execute: 

a drawing step which sequentially draws said 
image frames forming said dynamic image ac- 
cording to order in time in which said image 
frames appear in said dynamic image; 
an accumulation step which accumulates a part 
of at least one of said image frames drawn at 
the drawing step; and 

a decorating step which decorates each of the 
image frames forming said dynamic image by 
synthesizing each of the image frames drawn 
at the drawing step with an image obtained by 
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enlarging the part of at least one of the image 
frames which has been drawn earlier than the 
image frames to be decorated. 

A program read and executed by an program exe- 5 
cuting apparatus, said program allowing said pro- 
gram executing apparatus to create image frames 
forming a dynamic image and allowing the program 
executing apparatus to execute: 

10 

a drawing step which sequentially draws said 
image frames forming said dynamic image ac- 
cording to order in time in which said image 
frames appear in said dynamic image; 
an accumulation step which accumulates a part is 
of at least one of said image frames drawn at 
the drawing step; and 

a decorating step which decorates each of the 
image frames forming said dynamic image by 
synthesizing each of the image frames drawn 20 
at the drawing step with an image obtained by 
enlarging the part of at least one of the image 
frames which has been drawn earlier than the 
image frames to be decorated. 

25 

An program executing. apparatus for executing a 
program for displaying a dynamic image comprising 
image frames whose contents change in accord- 
ance with operations of a user, said program exe- 
cuting apparatus comprising: 30 

drawing means which sequentially draws said 
image frames forming said dynamic image ac- 
cording to order in time in which said image 
frames appear in said dynamic image; 35 
accumulation means which accumulates a part 
of at least one of said image frames drawn at 
the drawing step; and 

decorating which decorates each of the image 
frames forming said dynamic image by synthe- 40 
sizing each of the image frames drawn at the 
drawing step with an image obtained by enlarg- 
ing the part of at least one of the image frames 
which has been drawn earlier than the image 
frames to be decorated. 45 
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(57) A dynamic image is decorated effectively with 
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image A that forms a dynamic image representing a 
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